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Abstract 

Scheduling  in  flexible  manufacturing  systems  (FMS)  must  take  into 
account  the  shorter  lead-time,  the  multiprocessing  environment,  the 
dynamic  changing  states,  and  the  flexibility  of  machines.   This  paper 
presents  a  novel  approach,  based  on  the  pattern-directed  inferencing 
paradigm  for  intelligent  systems,  for  scheduling  in  the  FMS  environment. 
The  approach  models  the  scheduling  problem  by  a  state-space  planning 
process  wherein  schedules  are  generated  by  heuristic  searching.   With 
its  use  of  symbolic  state-space  representation  and  pattern-directed 
mechanism,  such  a  scheduling  approach  is  shown  to  capture  characteristics 
unique  to  the  FMS  environment.   This  paper  also  reports  computation 
results  in  an  effort  to  evaluate  the  utility  of  various  heuristic  func- 
tions, to  identify  important  design  parameters,  and  to  analyze  the 
resulting  computation  performance  in  using  the  approach  for  scheduling. 
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1.   Introduction 

Flexible  manufacturing  systems  (FMSs),  the  type  of  manufacturing 
systems  that  can  produce  a  variety  of  items  efficiently,  have  become 
increasingly  important  in  the  effort  to  improve  the  productivity  of 
batch  manufacturing.   An  FMS  consists  of  a  number  of  computer- 
controlled  machines  or  workstations,  an  automated  material  handling 
system  which  transports  workplaces  between  any  pair  of  machines,  and 
a  number  of  supervisory  computers  networked  together  for  on-line  deci- 
sion making.   By  integrating  the  versatile  numerical  control  (NC) 
machines  with  the  real-time  decision-making  capability  of  the  super- 
visory computers,  an  FMS  is  able  to  reduce  the  flow-time  and  the  set- 
up time  significantly  and,  thus,  achieves  much-needed  efficiency  in 
manufacturing  several  different  jobs  simultaneously.   The  flexibility 
of  the  system  also  allows  the  choice  of  more  than  one  machine  for  a 
given  operation,  enabling  production  to  continue  even  when  some 
machines  are  out  of  order.   The  flexibility  and  adaptability  features 
of  FMSs  give  new  challenges  to  the  design  of  an  effective  scheduling 
approach  (Merchang,  1983;  Ranky,  1983;  Hutchingson,  1984). 

The  scheduling  of  jobs  in  an  FMS  has  been  addressed  by  a  number  of 
researchers  within  a  hierarchical  framework,  where  the  scheduling 
decision  consists  of  three  levels  (Buzacott  (1982),  Hitz  (1979),  Nof 
et  al.  (1979),  Gershwin  et  al.  (1985),  Buzacott  and  Yao  (1986)): 

Level  1:   Prerelease  planning  -  Deciding  the  job  mix  to  be  manufactured 
and  the  constraints  on  operation  sequence. 
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Level  2;   Job  entry  control  -  Determining  the  sequence  and  timing  of 
release  of  job. 

Level  3:   Operation  and  flow  control  -  Ensuring  the  best  routings  for 
the  jobs  based  on  the  availability  of  machines  and  other  resources. 

This  paper  focuses  on  the  scheduling  aspect  at  the  operation  and 
flow  control  level  of  the  decision  hierarchy.   That  is,  if  the  pro- 
duction mix  of  jobs  is  specified  and  the  job  entry  sequence  is  known, 
to  determine  the  machine  assignments  and  manufacturing  paths  for  the 
jobs  dispatched  into  the  system.   Such  a  scheduling  decision  can  be 
made  by  enumerating  the  manufacturing  paths  in  advance,  or  by  establish- 
ing a  set  of  decision  rules  which  determine  machine  assignment  in  real 
time  as  the  workpiece  makes  its  way  through  the  system  (Buzacott,  1982). 
In  the  FMS  environment,  where  the  machines  are  flexible  but  subject  to 
failures,  the  ability  to  schedule  jobs  in  real  time  and  to  reschedule 
jobs  dynamically  is  desirable.   Hitz  (1979)  used  a  periodic  scheduling 
algorithm  to  evaluate  schedules,  but  the  approach  required  that  the  job 
routings  be  determined  in  advance.   Kimemia  and  Gershwin  (1985)  devel- 
oped optimization  techniques  for  solving  the  flow  control  problem  by 
mathematical  programming.   Park  and  Shaw  (1986)  incorporated  sequencing 
heuristics  to  integrate  the  job  entry  and  flow  control  level  in  FMS  sche- 
duling.  Buzacott  and  Yao  (1986)  provide  a  comprehensive  survey  on  the  analy- 
tical techniques  that  have  been  developed  and  used  in  all  three  levels  of  the 
decision  hierarchy. 

This  paper  takes  a  drastically  different  approach  in  handling  the 
scheduling  decision  at  the  operation  and  flow  control  level.   It  models 
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the  scheduling  process  by  state-space  transitions  and  the  routing  is 
obtained  through  selecting  a  sequence  of  scheduling  operators.   The 
approach  can  be  characterized  as  pattern-directed  (Hayes-Roth  and 
Waterman,  1978);  it  has  features  particularly  suitable  for  FMS  schedul- 
ing.  First,  it  is  flexible  in  selecting  the  most  appropriate  manufac- 
turing path  among  the  alternatives,  without  having  to  enumerate  all  the 
possibilities  in  advance.   Second,  the  approach  is  adaptive  to  changes 
in  the  FMS  environment  caused  by  unexpected  machine  failures  or  tool 
breaks,  or  changing  job  combination  due  to  new  arrivals.   (A  dynamic 
scheduling  scheme  is  discussed  in  Shaw  and  Whinston  (1986).)   Third, 
the  program  organization  used  in  this  approach  fits  the  description  of 
a  physical  symbol  system,  which  has  been  empirically  shown  to  be  the 
foundation  of  designing  intelligent  systems  (Newell  and  Simon,  1972, 
1976).   Shaw  (1986b)  has  shown  the  incorporation  of  machine  learning  in 
the  scheduling  system  discussed  in  this  paper,  based  on  the  operator- 
learning  method  developed  in  Fikes  et  al.  (1972),  Michalski  et  al. 
(1983),  and  Korf  (1985).   In  a  prior  study,  Jones  et  al.  (1986)  pro- 
posed a  control  structure  for  the  automated  manufacturing  research 
facility  (AMRF)  in  the  National  Bureau  of  Standards;  they  expressed  the 
need  for  a  uniform  framework  for  carrying  out  intelligent  planning, 
scheduling,  and  learning  in  the  completely  automated  factory.   The 
approach  described  in  this  paper  is  aimed  at  developing  a  methodology 
that  can  integrate  these  functions  in  an  FMS. 

The  proposed  methodology  can  provide  a  useful  tool  to  the  OR  com- 
munity.  The  traditional  approaches  applied  to  solving  scheduling 
problems  fall  in  either  of  three  areas:   network  analysis,  combinatorial 
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methods,  and  heuristic  procedures.   However,  network  analysis  is 
usually  based  on  a  predetermined  network  and,  thus,  is  inadequate  for 
dynamic  scheduling  where  the  precedence  network  is  constantly  changing. 
Combinatorial  method,  also  restricted  to  static  scheduling,  suffers  from 
the  complexity  problem  (i.e.,  combinatorial  explosion)  which  is  dif- 
ficult to  overcome  for  large  problems.   The  heuristic  scheduling  proce- 
dures use  relatively  simple  knowledge  representation  and  are  restricted 
to  limited  intelligence — they  use  rigid  heuristic  which  cannot  adapt  to 
evironmental  changes  (Grant  (1986),  Brund  et  al.  (1986),  and  Kusiak 
(1986b)).   In  contrast,  the  approach  presented  in  this  paper  can  dynami- 
cally generate  schedules  represented  by  partially  ordered  networks;  it 
can  incorporate  heuristic  knowledge  to  facilitate  the  scheduling  pro- 
cess; lastly,  it  is  equipped  with  a  structured  representation  scheme 
based  on  the  pattern-directed  inference  organization  (Hayes-Roth  and 
Waterman,  1978),  which  has  been  used  as  an  information  process  model  for 
human  problem  solving. 

This  paper  addresses  the  pattern-directed  approach  in  three  aspects: 
(1)  the  formalization  of  the  FMS  scheduling  problem  as  a  pattern- 
directed  process,  (2)  the  planning  mechanism  for  generating  schedules, 
and  (3)  the  use  of  heuristic  information  and  its  impacts  on  scheduling 
performance.   The  paper  is  organized  as  follows:   Section  2  develops  a 
state-space  planning  formalism  to  describe  the  FMS  scheduling  problem. 
In  Section  3,  an  A*  heuristic  algorithm  for  plan  generation  and  a  nonli- 
near planning  algorithm  for  multijob  scheduling  are  presented.   Section 
4  uses  an  FMS  scheduling  example  to  illustrate  major  features  of  the 
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proposed  approach.   Section  5  contains  a  computation  study  and  perfor- 
mance analysis  on  the  scheduling  algorithm  and  the  use  of  heuristics. 
Finally,  Section  6  concludes  the  paper. 

2.   State-Space  Planning 

2.1   Job  Routing  and  Dynamic  Scheduling 

A  planning  system  is  a  program  which  develops  a  course  of  action, 
or  a  "plan,"  for  the  agents  to  reach  the  goals  desired;  the  plan  will 
then  be  used  to  guide  the  execution  of  planned  activities.   In  flexible 
manufacturing,  the  agents — which  may  be  robots,  computerized  machine- 
centers,  or  the  host  computer  of  a  manufacturing  cell — can  carry  out  a 
variety  of  operations,  including  various  types  of  machining,  workpiece 
routing,  loading,  and  unloading  operations. 

Formally,  a  planning  system  P  can  be  defined  by  a  quadruple: 

(2.1)    P  =  (S,  OP,  Sq,  S^) 

where  S  is  the  set  of  states,  OP  is  the  set  of  operators  defined  by  a 

state-transition  mapping  from  one  state  to  another,  i.e.,  OP:   S  ->•  S, 

S-.  is  the  initial  state  of  the  problem,  and  S  is  the  desired  goal  state, 
U  G 

S-,  S  c  S.   In  this  section  we  shall  describe  the  FMS  scheduling  by 
such  state-space  representation,  which  provides  a  formalism  for  dynami- 
cally representing  the  FMS  environment  in  scheduling;  the  state  descrip- 
tions are  stored  symbolically  in  a  database.   The  mechanism  for  generating 
schedules  is  based  on  the  planning  process  and  will  be  discussed  in  Sec- 
tion 3. 

The  description  of  the  planning  problem  can  be  formalized  by  first- 
order  predicate  calculus  (Nilsson,  1980).   Well-formed  formulas  (wffs) 
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are  used  to  describe  states.   Thus,  the  initial  state  and  the  goal 
state  are  both  represented  by  a  set  of  wffs.   Operators  are  described 
in  two  parts.   The  first  part  states  the  preconditions  that  must  be  met 
before  the  operator  can  be  applied.   The  second  part  of  an  operator 
description  is  a  description  of  a  function  on  the  states,  defining  how 
the  operator  affects  the  states  of  the  world  when  it  is  applied,  i.e., 
the  post  conditions  of  the  operator.   The  conventional  planning  systems 
(e.g.,  see  Nilsson  [1980])  represent  the  post  conditions  of  an  operator 
by  two  lists:   the  add-list  and  the  delete-list.   The  add-list  contains 
those  facts  that  become  true  after  the  invocation  of  the  operator;  the 
delete-list  contains  those  facts  that  become  invalid  after  the  invoca- 
tion. 

The  objective  of  the  planning  process  is  to  find  an  appropriate 
sequence  of  instantiated  operators  (i.e.,  the  arguments  in  the  operators 
have  been  substituted  with  constant  values  by  pattern-matching)  that  can 
transform  the  world  from  the  state  satisfying  S   into  a  state  satisfying 
S  .   Given  S^,  S_,  and  the  set  of  operators  OP,  we  shall  call  such  a 

sequence  of  operators  a  plan  for  achieving  S  ,  given  S„.   That  is,  the 

0        u 

planning  process  can  be  viewed  as  a  transformation  from  S  to  S  by 

U      0 

producing  a  plan  i|) , 


(2.2)     [Initial  State  (S^)]  — >  [Goal  State  (S  )] 


where  tp  is  generated  through  a  sequence  of  operator  selections: 


a^     a.     a       a 

(2.3)    S^  -->  S,  -->   S^  -->...  -^>  S^   ;   a.  e  OP. 
0      12  G      1 
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For  FMS  scheduling,  each  S.  represents  an  instance,  or  a  state,  of 
the  FMS  environment.   S^  contains  the  initial  conditions  when  the  sche- 
dule begins  whereas  S  indicates  the  ending  conditions  for  the  jobs  to 
be  completed.   Each  a.  is  an  operator,  representing  a  manufacturing 
activity,  selected  by  matching  the  preconditions  of  the  operator 
against  the  state  descriptions.   Letting  ii   erepresent  a  sequence  of  operator 
applications,  we  use 

(2.4)    ^qM^g 

to  denote  that,  if  the  set  S   is  true  before  the  sequence  of  operators 
^    is  applied,  then  S„  will  be  true  after  ^    is  applied. 

Following  this  state-space  paradigm,  an  FMS  scheduling  problem  can 
be  represented  as  a  planning  problem  defined  by  the  quadruple  (S,  OP, 
S^,  Sp)  as  follows: 

Problem  2.1  (The  Routing  Problem):   In  an  FMS,  suppose  the  operation 

requirements  of  the  jobs  are  specified  by  Jq;  the  environment  status  and 

the  machine  loading  (the  assignment  of  operations  to  machines)  at  state 

t  are  represented  by  E  ;  the  job  status  at  state  t  is  represented  by  J  . 

The  scheduling  problem  can  be  represented  by  a  quadruple  (S,  OP,  S  ,  S  ) 

,  U    G 

where 


(2.5)  Sq=  Eq&  Jq; 

(2.6)  S^  =  J^;  and 

(2.7)  S^  =  E^  &  J^. 

where  Jq  denotes  the  completion  of  the  job  requirements  and  S^  denotes 
the  state  description  at  the  state  t. 

Basically  a  single-job  version  of  Problem  2.1  is  a  direct  applica- 
tion of  the  robot  planning  technique,  exemplified  by  the  STRIPS  system 
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in  (Fikes  and  Nilsson,  1971,  1972);  the  objective  is  to  select  a 

sequence  of  scheduling  operators  a^a.  ...  a  to  determine  the  movements 
^  or         0  1      n 

of  the  job  based  on  the  available  machines  and  their  loading. 


Example  2»1:   Suppose  we  have  an  FMS  cell  consisting  of  two  work- 
stations Hi   and  M2.   Parts  are  fed  to  either  one  of  the  two  work- 
stations from  a  shared  buffer  by  a  robot.   Assume  that  hi   can  perform 
operations  0P2  and  0P5  and  M2  can  perform  0P3  and  0P4.   Suppose  a  job. 
JA,  is  in  the  buffer  waiting  to  be  processed;  the  completion  of  JA 
requires  two  operations:   0P3  and  OPS. 


The  planning  problem  is  represented  by  a  quadruple  (S,  OP,  S-^,  S  ). 
OP,  the  set  of  operators,  is  defined  in  Figure  2.1.  The  initial  state, 
S^,  is  the  conjunction  of  J^  (the  job  requirement)  and  E„  (the  environ- 
ment descriptions): 

J  :   FIRST-OP  (JA,  0P3)  &  PT-NEXTOP  (JA,  OPS,  0P5)  &  PT-NEXTOP 
(JA,  0P5,  <t)) 

E  :   MACH-OP  (^a ,  0P2)  &  MACH-OP  (Ml,  0P5)  &  MACH-OP  (M2,  0P4) 

&  MACH-OP  (M2,  0P3)  &  IDLE  (Ml)  A  IDLE  (M2)  &  PART-IN-BUFFER 
(JA)  &  ARM-EMPTY 
The  goal  state,  S^,  is 

PART-DONE  (JA)  &  ARM-READY. 
The  resulting  plan,  in  the  form  of  a  sequence  of  instantiated  operators, 
is  shown  in  Figure  2.2.   This  example  is  but  a  simplified  version  of 
the  FMS  scheduling  problem;  its  main  purpose  is  to  illustrate  the  rela- 
tion between  the  state-space  representation  and  the  planning  process. 
A  more  general  FMS  scheduling  problem  is  described  in  Section  4  where 
each  operation  can  be  performed  on  several  workstations  and  there  are 
multiple  jobs  included  in  the  schedule. 


(1)      LOAD   (pt,  m) 

P:      PART-IN-BUFFER  (pt)  & 

IDLE  (m)  8c  ARM-READY 
A  :     MACH-PT  ( m ,  pt )  &  ARM-OUT 
D:      IDLE  (m)&c  ARM-READY  &C 

PART-IN-BUFFER  (pt) 


(4)    CHANGE-TOOL  (m,opx,opy,pt) 
P:  FINISH-OP  (m,opx,pt)  & 
PT-NEXTOP  (opx,opy,pt)  & 
MACH-OP  (m,  opy) 
A:  MACH-PT  (m,  opy,  pt) 
D:  FINISH-OP  (m,  opx,  pt) 


(2)     UNLOAD   (pt,  m) 

P:      FINISH-OP  (m,  op,  pt)  & 

ARM-READY  & 

PT-NEXTOP  (op,  nil,  pt) 
A:     PT-DONE  (pt)Sc 

IDLE  (m)  &C  ARM-OUT 
D:      FINISH-OP  (m,  op,  pt)  & 

ARM-READY 


(5)    ARM-RESET 
P  :  ARM-OUT 
A  :  ARM-READY 
D  :  ARM-OUT 


(3)     TRANSFER  (mx,  my,  pt) 

P:      FINISH-OP  (mx,  opx,  pt)  & 
DIFFERENT  (mx,  my)  & 
PT-NEXTOP  (opx,  opy,  pt)  & 
MACH-OP  (my,  opy)  & 
IDLE  (my) 
A:     MACH-PT  (my,  opy,  pt) 

IDLE  (mx) 
D:      FINISH-OP  (mx,  opx,  pt)  & 
IDLE  (my) 


(6)    EXECUTE  (m,  op,  pt) 

P:  MACH-PT  (m,  op,  pt)  & 

TOOL  (m,  op,  pt) 
A:  FINISH-OP  (m,  op,  pt) 
D:  MACH-PT  (m,  op,  pt) 


(A:  Add-list,     P:   Precondition,       D:   Delete-list) 


Fig.  2.1        Operators   for  Example   2.1 


so  LOAD  SI  S2^  EHECUTE  S3^       THflNSFEf 

^       (Jfl,  M2)  ^      ARM-RESET  ►      (M2, 0P3,  JB)  ^    (M2,  Ml,. 


S4^  EHECUTE  S5^        UNLOAD         S6^ 

^    (M1,0P5,JA)  ^       (JA,  Ml)  ^      ARM-RESET  ►   S7 


Fig.  2.2        A    Manufacturing  Plan  for  Example  2.1 
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A  major  characteristic  of  FMS  scheduling  is  the  frequent  require- 
ment for  dynamic  scheduling  when  unanticipated  events,  such  as  tool- 
breaks  or  new  job  arrivals,  occur.   The  pattern-directed  scheduling 
approach  can  quite  effectively  handle  this  aspect  by  keeping  track  of 
the  state  descriptions  and  then  executing  the  same  planning  mechanism. 

Let  us  define  the  sequence  ^ r.    .    be  a  "prefix"  of  the  sequence  ^   = 

u ,  1 

a^a,  a«  ...  a  if  and  only  if  there  exist  a  sequence  i|^ .  , ,    such  that  -l)   = 
0  1  2      n  ■^  ^  1+1, n 

t1)^    .4'.,,    (i.e.,  Tp    is  equal  to  the  concatenation  of  i)^    .    followed  by 
0,1  1+1, n  0,i  -^ 

ij;     ).   The  dynamic  scheduling  problem  corresponding  to  Probelm  2.1 
can  then  be  defined  as  follows: 


Problem  2.2  (Dynamic  Scheduling):   Suppose  the  scheduled  activities  for 
the  current  job  are  represented  by  the  sequence  of  operations  \li   =  a^a^  a 

...  a^^   If  the  actual  state  description  at  state  i,  S^,  is  different 
from  the  planned  one,  i.e.,  when 

then  dynamic  scheduling  is  needed  to  find  a  new  schedule  to  accommodate 
the  changes  and  adjust  the  solution  path  to  reach  the  goal  state.   The 
subplan  from  state  i  to  the  goal  state  is  revised  by  constructing  ii\       , 
such  that,  ' 


(2.9)    S^(i|;'.  ^}S^,  and 


(2.10)   ^\>  =  'l^n  •  1^'   • 

new    0,1-1  i,n 


The  same  planning  mechanism  can  then  be  used  to  construct  ii  I 

i,n 

2.2  Multi-job  Scheduling  and  Nonlinear  Planning 

Having  defined  the  FMS  routing  problem  and  its  dynamic  scheduling 
version  based  on,  the  state-space  planning  paradigm,  we  shall  now  extend 
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the  representation  to  the  general  N-job-M-machine  FMS  scheduling  problem, 
Since  an  FMS  typically  can  execute  several  different  jobs  simulta- 
neously, the  goal  state  S  of  the  multijob  FMS  scheduling  problem  is 
expressed  as  a  conjunction  of  predicates:   DONE(Job  1)  A... A  DONE  (Job 
N).   If  there  is  no  interaction  between  the  plan-generation  for 
completing  individual  jobs,  then  the  plan  for  each  job  can  be  executed 
in  parallel.   In  reality,  however,  it  is  often  the  case  that  some  jobs 
may  compete  for  machines  or  other  resources,  causing  complications  in 
constructing  a  plan  for  finishing  all  jobs.   The  same  situation  also 
occurs  in  planning  for  multiple  agents,  where  coordination  among  indi- 
vidual plans  is  essential  (Chapman,  1986;  Pednault,  1985).   Because  of 
the  necessity  of  ensuring  proper  precedence  relationships  among  opera- 
tors to  avoid  potential  conflicts  in  these  situations,  the  resulting 
plan  is  often  partially  ordered.   This  type  of  planning  is  commonly 
referred  to  as  nonlinear  planning  because  of  the  partial  ordering  of 
operators  (Sacerdoti,  1977;  Tate,  1977;  Vere,  1983;  Wilkins,  1983,  1984), 
In  this  context,  the  FMS  scheduling  problem  can  be  defined,  in  terms  of 
its  input,  output,  and  the  corresponding  planning  process,  as  follows: 

Problem  2.3  (Multi-job  Scheduling): 
Input: 

-  The  initial  state  S^.,  the  goal  state  S^,  the  set  of  scheduling 
operators  OP. 

o 

-  The  resources  available  C  =  {C,  iel},  where  I  is  the  index  for 
the  set  of  resources. 

-  A  set  of  due-dates  y. 

-  A  performance  objective. 
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Output: 

-  The  set  of  instantiated  operators  A  =  {a,,  a  ,  ...,  a  }  representing 
the  planned  activities. 

-  A  vector  of  duration  X  =  {x.  ,  x_ ,  ....  x  }  where  x.  =  x(a,)  denotes 

r-  1*2'     '   n         1      1 

the  duration  of  a.. 

1 

-  A  partial  order  6  on  A  which  describes  the  precedence  constraints 
between  the  activities.  9(A)  is  a  partially  ordered  network, 

where  a,  .  a.  means  that  a.  must  be  finished  before  a.  can  be  started, 
i  <  J  1  J 

-  A  vector  of  resource  consumptions  C  =  {c^ ,  c-,  ...,  c  }  where  c.(a.) 
denotes  the  amount  of  resource  i  required  by  activity  a..         -^ 

-  A  vector  T  =  {T(a  ),  T(a  ),  ...,  T(a  )}  that  gives  the  starting  time 

of  all  activities.   For  all  a.  and  a., 

1      J 

T(a.)  +  x(a.)  <   T(a  ) 

g 

if       a.  .  a .  in  6 . 
1  <  J 

Planning  Process: 

-  To  derive  a  set  of  instantiated  operators  A  with  the  corresponding 
partial  ordering  6  such  that 


(2.11)  Sq  {e(A)}Sg; 

o 

(2.12)  ZC.(a.)  _<  C.  at  any  state  t,  0  £  t  <_  G; 
i    ^ 

(2.13)  Meeting  the  performance  objective,  defined  by  f(T,  X,  D) , 
whereas  the  commonly  used  scheduling  objectives  include: 

-  Minimizing  the  raakespan:   f(T,  X,  D)  =  f(r  ,  ...,  r  )  =  max{r  ,  ...,  r_} , 
where  r  is  the  time  at  which  the  job  i  is  achieved; 

-  Minimizing  the  mean  flow-time:   f(T,  X,  D)  =  (ZrJ/m;  or 

i 

-  Meeting  the  due-dates:   r,  _<  y.  ;  1  <_  i  _<  m. 


ra 
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This  paper  is  aimed  at  solving  the  FMS  scheduling  problem  with 
minimum  makespans;  the  schedule-generation  process  is  facilitated  by 
heuristic  searching.   Alternatively,  Fox  (1983)  developed  a  "constraint- 
directed"  method  to  solve  job-shop  scheduling  problems  with  due-date 
constraints;  the  search  method  used  there  is  a  "beam-search"  method 
(Fox  et  al.,  1983;  Ow,  198A). 

Underlying  Problem  2.3  is  an  interesting  contrast  between  this 
approach  and  the  conventional  OR/MS  approaches.   That  is,  the  solution 
process  of  Problem  3.3  generates  a  set  of  operators  and  the  correspond- 
ing partial  ordering,  whereas  the  scheduling  problems  in  the  OR/MS 
literature  often  use  such  a  partially  ordered  network  as  input  (Davis 
and  Patterson,  1975;  Lageweg  et  al.  1972;  Schrage  and  Baker,  1978). 
This  difference  in  the  problem  statement  results  in  an  important  char- 
acteristic of  the  pattern-directed  scheduling  approach:   the  schedules 
are  determined  based  on  the  current  system  status  (represented  as 
states  in  the  world  model)  and  the  decision  rules  (represented  by 
operators).   There  is  no  need  to  pre  enumerate  the  manufacturing  path. 

The  other  characteristic  of  Problem  2.3  is  the  way  the  problem  is 
specified:   the  scheduling  problem  is  defined  by  the  initial  state,  the 
desired  goal  state,  and  the  set  of  operators.   The  user  does  not  have 
to  know  how  to  formulate  the  problem,  as  is  the  case  when  matheraatic 
programming  techniques  are  used  (e.g.,  Kimemia  and  Gershwin  (1985)). 
This  separation  of  control  knowledge  (planning),  data  (state  descrip- 
tions and  goal)  ,  and  problem-solving  knowledge  (operators)  is  an  impor- 
tant feature  of  most  AT  programs.   For  FMS  scheduling,  this  feature 
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enables  the  scheduler,  a  planning  system,  to  be  adaptive  to  the  environ- 
mental changes.   Any  state  changes  would  affect  the  state  description 
in  the  world  model,  but  not  the  control  knowledge  or  operators.   Thus 
the  scheduling  process  would  adjust  itself  according  to  the  changing 
states  without  having  to  resolve  the  whole  problem  again. 

Such  adaptability  can  be  illustrated  by  extending  the  formalization 
defined  in  Problem  2.2,  with  the  addition  of  explicit  resource,  time, 
and  precedence  ordering  information.   For  example,  if  at  an  instance, 
say  t. ,  during  the  execution  of  the  scheduled  activities,  the  actual 

state  description  S   differs  with  the  projected  state  description  S   , 

^1  h 

then  the  scheduler  would  have  to  account  for  the  state  changes.   The 

same  planning  process  can  be  used  to  generate  a  partially  ordered  plan 

with  the  set  of  planned  activities  A  and  the  corresponding  partial 

ordering  6   such  that 

(2.ir)   S^  {9i(A^)ls^; 


(2.12')   EC. (a,.)  <  C.  at  any  state  t, 
.  1   It  —  1      ^        * 

1     -^ 


where  t,  <  t  <  G  and  a, .  e  A  • 
1  —   —       Ij    1' 


(2.13')   Meeting  the  designated  scheduling  objective, 


The  only  changes  in  generating  the  schedule  is  the  actual  state  descrip- 

tion  S   which  serves  as  the  new  state  description  at  t^ .   There  is  no 

1 
need  to  resolve  the  whole  problem.   Essentially,  the  scheduling  process 

is  driven  by  state  information,  while  necessary  adjustments  are  made 

automatically  by  the  same  planning  process  for  selecting  a   's. 
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3.   Schedule  Generation  and  Searching 

3.1   Schedule  Generation  by  Heuristic  Searching 

In  the  preceding  sections,  we  have  described  a  model  for  the  FMS 
scheduling  problem  based  on  the  pattern-directed  paradigm  of  Intelli- 
gent problem  solving.   Within  such  a  framework,  the  scheduling  system 
has  three  essential  components: 

1.  A  database  storing  state  descriptions  of  the  FMS  environment. 

2.  A  set  of  operators  (sometimes  referred  to  as  pattern-directed  modules) 
that  modify  the  descriptions  In  the  database,  so  as  to  produce 

more  refined  sets  of  potential  solutions.   These  operators  model 
manufacturing  activities. 

3.  An  Inference  engine  that  executes  the  control  scheme — It  decides 
at  any  given  time  the  most  appropriate  operator  to  apply  based  on 
the  state  descriptions  In  the  database.   This  process 
continues  until  the  schedule  Is  completed. 

Having  presented  the  formalism  to  represent  state  descriptions  and 

operators  In  FMS  scheduling,  we  shall  now  present  the  control  schemes 

to  achieve  the  planning  process  defined  In  Problem  2.3. 

The  planning  process  can  be  viewed  as  finding  the  solution  path  In 

a  search  tree,  carried  out  by  either  forward-  or  backward-chaining.   In 

forward-chaining,  the  root  of  the  tree  Is  the  Initial  state,  and 

Instances  of  operators  define  the  branches.   Searching  for  solutions  is 

accomplished  by  a  "generate-and-test"  process  (Newell  and  Simon,  1972): 

at  a  given  node,  corresponding  to  a  state  in  the  world  model,  new  nodes 

are  generated  by  applying  operators  (rules).   This  process  continues 

until  the  goal  state  is  generated.   The  backward  chaining  process 

operates  in  reverse  direction,  i.e.,  starting  with  the  goal  and  reaching 

for  the  initial  conditions.   The  key  issue,  then,  is  the  selection  of  the 

most  appropriate  operator  to  apply  at  a  given  state,  represented  as  a 
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node  in  the  search  tree.   The  plan-generation  process  can  be  achieved 
by  the  following  heuristic  search  procedure,  called  the  A  algorithm  in 
the  literature  (Nilsson,  1980;  Peal,  1983): 


Algorithm  3.1  (Operator-Search) 

Input: 

So*   the  initial  state 

Sq:   the  goal  state 

OP:   the  set  of  operators 

Output; 

i|) :      a  linked    list   of    instantiated   operators. 

Begin 

1)  Place  Sq  on  a  list  called  OPEN;  create  a  list  called  CLOSED 
that  is  initially  empty. 

2)  LOOP:   If  OPEN  is  empty,  exit  with  failure. 

3)  Remove  from  OPEN  and  place  on  CLOSED  a  node  n  for  which  f(*)  is 
minimum. 

4)  If  n  matches  S^,  exit  successfully  with  the  plan  constructed  by 
tracing  the  solution  path  from  n  to  Sq.   Concatenate  the  operators 
in  the  order  of  their  application  to  form  the  plan  ^p,    (Pointers 
are  established  in  Step  (5).) 

5)  Otherwise  expand  node  n,  applying  all  applicable  operators  in  OP 
to  generate  the  set  of  all  its  successors,  T;  attach  to  the  nodes 
in  T  pointers  back  to  n. 

For  every  successor  x  in  T,  Do 

Begin 

6)  If  x  is  not  already  on  OPEN  or  CLOSED,  estimate  h(x),  and  cal- 
culate 

f(x):  =  g(x)  +  h(x)  where 

g(x):  =  g(n)  +  c(n,x);  c(n,x)  is  the  cost  of  applying  the 
operator  corresponding  the  x. 
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7)  If  X  is  already  an  OPEN  or  CLOSED,  direct  its  pointers  along  the 
path  yielding  the  lowest  g(n). 

End 

8)  Go  to  step  (2) 
End 

The  foregoing  procedure  essentially  transforms  the  planning  process 
into  a  graph  search  procedure  guided  by  a  heuristic  function.   The 
procedure  keeps  two  lists  in  the  process  of  generating  the  search 
tree:   an  OPEN  list  contains  all  the  nodes  yet  to  be  expanded  (the 
leave  nodes  of  the  search  tree);  a  CLOSED  list  contains  all  the  nodes 
already  expanded  (the  nonleave  nodes).   For  the  A*  algorithm,  the 
heuristic  function  f(*)  consists  of  two  components:   f(n)  =  g(n)  +  h(n), 
where  g(n)  =  the  cost  of  the  path  found  by  A*  from  S„  to  n;  and  h(n)  = 
the  estimated  cost  of  a  path  from  n  to  S^, 

The  A*  algorithm  is  a  best-first  searching  procedure  which  uses 
the  heuristic  function  f(*)  to  guide  the  search  of  the  optimal  path. 
Studies  (Hart  et  al. ,  1968;  Nilsson,  1980;  Peal,  1983)  have  shown  that 
when  A*  employs  a  perfectly  informed  heuristics  (h=h*)  it  is  propelled 
directly  toward  the  goal  without  ever  getting  sidetracked,  spending 
only  M  computational  steps  where  M  is  the  number  of  state-transitions 
to  the  goal  node.   At  the  other  extreme,  when  no  heuristic  knowledge  is 
available  (c(n,x)=l,  h  =  0;  c(n,x)  represents  the  cost  of  applying  an 
operator  expanding  n  to  x) ,  the  search  becomes  breadth-first,  yielding 
an  exponentially  growing  complexity. 

In  generating  schedules  based  on  the  state-space  planning  approach, 
the  optimal  path  consists  of  a  sequence  of  operators  that  yield  the  best 


-17- 

schedule.   The  selection  of  these  operators  can  be  accomplished  by 

algorithm  3.1,  where  the  A*  heuristic  is  used  to  guide  the  search.   In 

general,  an  A*  algorithm,  such  as  Algorithm  3.1,  guides  the  search  of 

optimal  path  by  excluding  unnecessary  node  expansions. 

Let  C-.  „   be  the  cheapest  cost  of  paths  going  from  S^,  to  S-,  i.e., 
U  ,0  U      b 

* 

C„   =  h*(S^).   If  the  cheapest  cost  of  all  solution  paths  constrained 
U ,  G        U 

to  go  through  n  is  denoted  by  f*(n)  ,  then 

(3.1)  f*(n)  =  g*(n)  +  h*(n),  for  any  n,  and 

(3.2)  f*(n)  =  C^  ^  for  n  £   P„   _ 

U,G  Sq,S^ 

*  * 

(3.3)  f*(h)  >  C^  ^  for  n  9'  P^   _ 

U,G  bQ.bg 

* 

where  P      stands  for  the  set  of  optimal  path  from  S„  to  S  .   Then 
Sq,S^  U     G 

conditions  (3.2)  and  (3.3)  imply  that  following  the  minimum  f*  would 
constitute  a  perfect  search  strategy  leading  straight  toward  an  optimal 
solution  without  ever  getting  sidetracked.   However,  usually  information 
on  f*(n)  is  not  possessed,  especially  the  h*(n)  component.   The  A* 
heuristic  is  aimed  at  estimating  C„    and  providing  a  measurement  on 
how  promising  a  node  is  to  be  on  the  optimal  path.   The  performance  of 
the  A*  algorithm  is  dictated  by  the  following  two  lemmas: 


Lemma  3.1:   If  there  exists  a  path  from  the  initial  state  S,^  to  the 
goal  state  S„,  the  A*  algorithm  must  terminate  in  finite  steps. 

Lemma  3.2;   When  the  A*  algorithm  uses  a  heuristic  function  that  con- 
tains an  h( . )  component  such  that 


(3. A)    0  <  h(n)  <  h*(n),  for  every  node  n, 


then  the  A*  algorithm  only  terminates  by  finding  optimal  path  to  the 
goal. state. 
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Lemma  3.1  indicates  that  the  A*  algorithm  is  complete,  Lemma  3.2  indi- 
cates that  the  A*  algorithm  is  admissible.  A  search  algorithm  that  is 
guaranteed  to  find  an  optimal  path  to  a  goal,  if  one  exists,  is  called 
admissible  (Nilsson,  1980). 

3.2  Nonlinear  Planning:   A  Decomposition  Approach 

If  the  FMS  scheduling  problem,  Problem  2.3,  is  solved  by  Algorithm 
3.1  directly,  the  complexity  of  the  searching  procedure  can  grow  pro- 
hibitively large  (a  simpler  problem  than  Problem  2.3,  the  job-shop 
scheduling  problem,  has  been  shovm  to  be  NP-complete  (French,  1982; 
Garey  et  al.,  1976;  Gonzalez  and  Sahni,  1978;  Lenstra  and  Rinnooy  Kan, 
1978)).   In  general,  the  computation  complexity  of  a  searching 
procedure  is  determined  by  the  number  of  nodes  generated,  i.e.,  by  the 
size  of  the  search  tree.   For  plan  generation,  the  size  of  the  search 
tree  is  bounded  by  b  ,  where  b  is  the  branching  factor  and  d  is  the 
depth  of  the  tree.   For  a  N-job-M-machine  scheduling  problem  solved  by 
pattern-directed  inferencing,  b  is  affected  by  the  average  number  of 
applicable  operators  at  any  node  expansion;  d  is  proportional  to  the 

average  number  of  operation  of  each  job,  N   ,  i.e.,  d  =  ?  •  N   where  B, 
^  t^  ->   »   op  op 

is  a  constant.  For  multijob  scheduling,  both  b  and  d  are  also  propor- 
tional to  the  number  of  jobs  N  .  The  size  of  search  tree  of  Algorithm 
3.1  in  the  worse  case  would  be 

(b  X  Nj)5  "  "op   ''  '^J 

This  can  grow  into  a  huge  tree  even  for  very  small-sized  problems. 

To  overcome  this  complexity  difficulty,  we  employ  a  decomposition 
approach.   Specifically,  we  developed  a  nonlinear  planning  algorithm 
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which  decomposes  an  n-job-m-machine  problem,  defined  in  Problem  2.2, 
into  n  subprobleras ,  with  each  subproblem  defined  as  the  routing  of  one 
job  (Problem  2.1).   Algorithm  3.1  is  applied  to  generate  a  "plan"  for 
the  n  subproblems;  the  primary  interactions  between  these  subproblems 
are  their  sharing  of  the  machines.   The  objective  of  the  scheduling 
problem — to  minimize  makespan  while  avoiding  conflicting  assignments — 
can  be  translated  into  the  criterion  for  the  plan-generation  problem: 
to  maximize  the  parallelism  while  avoiding  harmful  interactions  among 
the  subplans.   This  procedure  is  shown  as  follows. 

Algorithm  3.2  (Nonlinear  Planning) 
Begin 

(1)  Generate  a  plan  for  each  job  by  Algorithm  3.1. 

(2)  Identify  conflicting  interactions  between  the  planned  opera- 
tors and  established  precedence  constraints  to  avoid  sched- 
uling conflicts. 

(3)  Use  a  Plan-Revision  Procedure  to  improve  the  raakespan  as  much 
as  possible. 

End 

The  flowchart  of  Step  2  is  shown  in  Figure  3.1.   This  procedure 
dynamically  decides  the  precedence  relationship  between  two  conflict- 
ing operators.   The  underlying  principle — based  on  the  least  commit- 
ment strategy — is  not  to  impose  any  precedence  constraint  unless  it  is 
absolutely  necessary,  so  that  the  parallelism  among  the  subplans  is 
maximized.   Information  about  resources  and  duration  of  operators  is 
crucial  to  the  inference  engine  in  making  these  decisions. 

When  a  precedence  constraint  is  established,  the  operator 
restricted  by  the  constraint  is  put  on  a  list  called  Alternate-list. 


START 


Initialization 


1.  (P-'-,T)    =    1st    entry 
"^  on  E-L 

2.  TNOW  =   T 


Y(r) 


Call   CONFLICT-DETECTION 
to   check  applicability 


1.  Apply  pi 

2.  Schedule  its  successor 
on  EVENT-LIST 


^ 


\^Y 


END 


N 


> 


1.  Activate  a 
blocked  action 

2.  Add  a  precedence 
constraint 


> 


put  ?■'■  on 

a  resource  queue 


Fig.  3,1        The  Flow  Chart  of  Step  2  of  AJgorithm   3.2 
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In  Step  3,  the  plan-revision  step,  the  scheduling  system  examines  each 
operator  on  the  Alternate-list  and  attempts  to  find  if  any  alternative 
resource  can  reduce  the  queueing  time.   If  such  a  resource  exists,  a 
forward-chaining  procedure  is  used  to  modify  the  related  section  of 
the  plan.   This  revision  procedure  is  executed  for  every  operator  on 
the  Alternate-list,  but  the  forward-chaining  procedure  is  executed 
only  if  reassigning  the  resource  can  improve  the  makespan.   The  Plan- 
Revision  procedure  is  described  as  follows. 

The  Plan-Revision  Procedure 

(1)  Select  the  first  operator  on  the  Alternate-list;  identify  the 
resource  for  which  this  operator  is  assigned, 

(2)  Locate  the  corresponding  critical  section  of  the  subplan. 

(3)  Compare  the  expected  waiting  time  with  the  additional  pro- 
cessing time  by  an  alternative,  idle  resource.   If  no  im- 
provement is  possible,  exit.   Otherwise,  go  to  Step  4. 

(4)  Find  out  the  initial  conditions  and  the  ending  conditions  of 
this  critical  section. 

(5)  Generate  a  forward-chaining  plan  that  can  transform  the  ini- 
tial conditions  to  the  goal  conditions,  using  another  idle 
resource. 

(6)  Modify  the  subplan  by  replacing  the  section  identified  in 
Step  2  with  the  newly  generated  plan  from  Step  5. 

Based  on  the  performance  properties  of  A*  heuristic  search,  we  can 
derive  the  following  theorem: 

Theorem  3.1.   Algorithm  3.2,  the  nonlinear  planning  algorithm,  is  both 
complete  and  correct  (for  proof  see  the  Appendix). 

Theorem  3.1  provides  two  performance  guarantees  on  applying 
Algorithm  3.2  to  the  multijob  FMS  scheduling  problem:   It  can  reach 
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the  solution  in  finite  steps  (completeness)  and  when  it  finishes,  it 
always  finds  the  solution  if  such  a  solution  exists  (correctness). 
However,  Algorithm  3.2  is  not  admissible  because  of  the  decomposition — 
it  only  achieves  suboptimal  schedules.   The  Plan-Revision  Procedure  is 
to  improve  the  suboptimal  schedule  as  much  as  possible  by  identifying 
alternative  resources  for  the  planned  activities. 

4.   An  Application  Example 

In  this  section  we  shall  use  an  example  to  illustrate  major  features 
of  the  scheduling  approach.   The  designated  FMS  of  this  example  is  shown 
in  Figure  4.1.   It  is  a  3-machine  cell  consisting  of  one  CNC  lathe  and 
two  CNC  milling  machines;  a  linear  table  and  two  robots  are  used  for 
material  handling,  loading/unloading,  and  transporting  workpieces  between 
machines.   There  is  a  cell-host  supervisory  computer  in  charge  of  the 
scheduling  and  control  of  the  cell  (Cutkosky,  1983).   The  operation 
capability  (i.e.,  loading)  of  each  machine  is  shown  in  Figure  4.2(a). 

Suppose  there  are  three  jobs  needed  to  be  scheduled,  denoted  by 
PT12,  PT6,  PT16,  each  job  requiring  a  different  set  of  operations  shown 
in  Figure  4.2(b).   The  system  configuration  and  the  job  profile  can  be 
translated  into  the  initial  state  shown  in  Figure  4.3.   The  set  of 
operators  are  shown  in  Figure  4.4.   Note  that  while  the  operators  are 
defined  by  the  STIRIPS-based  formalism  using  Preconditions,  Add-list, 
and  Delete-list,  two  additional  specifications — Resource  and  Duration — 
are  also  included.   These  two  pieces  of  information  are  important  for 
resource  coordination  and  conflict  resolution  in  Algorithm  3.2. 

Based  on  algorithm  3.2,  the  first  step  is  to  generate  a  plan 
for  each  job,  resulting  in  the  three  schedules  shown  in  Figure  4.5(a). 
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Fig.  4a        A  Flexible   Manufacturing  Cell 
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Fig.  4.2  (b)        Job  Requirements 
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Fig.  4.3   Initial  State  Descriptions 


TRANSFER(M,  M",  FT.  t)  :  Trinifer  p»rt  PT  (pob  Bichioe  M  «o  machine  VT 
at  time  t. 

hxooodiiion  ;  FINlSH-OP(M.  O?,  PT.  t) 

DrFTERENTCM.  VT) 

PT-NEXTOP(OP.  OP".  PT) 

MACH-OP(M*.  OP") 

rDLECM".  I) 
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dock  DOCK  u  tiac  t. 
Precoodiiion  :  IDLE(DOCK,  t) 

PT-NEXTOP(OP.  Sn..  PT) 
nNISH-OP(M,  OP.  PT.  I) 
Add-lUt  :  MACH-PT(DOCK.  •aaloid*.  PT,  t) 
t>clete.li»t  :  IDLE(DOC!C,  t) 

nNISH-OP(M,  OP.  PT.  t) 
Resource  :  M 
Duration  :  3 


NEXTOP(M.  OP.  OP".  PT.  t)  :  Perform  operation  Or  on  part  PT  followinf 
operatioa  OP  on  the  ume  machine  M. 

Preconditon  :  FtNISH-OP(M.  OP.  PT,  I) 

PT-NEXTOP(OP.  OP*.  PT) 

MACH-OP(M,  OPO 
Add-Ust  :  MACH-PT(M,  OP".  PT.  t) 
Delete-lijt  :  nNISH-OP(M.  OP.  PT.  t) 
Resource  :  M 
Duration  :  0 


EXrr(PT,  t.  &/)  :  Part  PT  which  i»  nnloaded  it  the  unJoidiat  dock  DOCK 
at  time  t  leaves  the  tyitem  at  lime  t-*-hi . 

Precondition  :  MACH-PT(DOCK.  'aaloid'.  7T.  t) 

TOOL(DOCK.  'onload*,  t) 
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IDLE(DOCK.  t+»/) 
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Add-U*t  :  MACH-PT  (DOCK.  LOAD.  PT.  t) 
Dclete-liit  :  tDLE(DOCK.  t) 
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Duration  :0 


EXECUTE(M,  OP.  PT,  t)  :  Execute  operation  OP  on  pan  PT  on  machine  M 
at  time  t. 

Precondition  :  MACH-PT(M.  OP,  PT.  t) 

TOOLfXt  OP.  t) 

Add-liit  :  FIMSH-OP(M,  OP,  PT.  t*t») 

Deleie-liit  :  >.1ACHPT(M.  OP,  FT.  t) 

Resource  :  M 

Duration  :  ti 


Fig.  4,4        The  Set  of  Operators 
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Fig,  4.6        A  Sample   Output  of  the  Scheduling  Program 
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Each  schedule,  produced  by  the  planning  procedure  of  Algorithm  3.1, 
consists  of  a  sequence  of  instantiated  operators  (only  the  operator  name 
and  the  corresponding  resource  are  shown  in  the  figure).   The  second 
step  of  the  algorithm  is  to  synthesize  the  linear  plans  into  a  single 
schedule  by  using  precedence  constraints  to  resolve  conflicts.   The 
final  step  is  to  improve  the  synthesized  plan  as  much  as  possible  by 
checking  each  delayed  activity  and  by  employing  alternative  resources. 
An  instance  of  plan  revision  occurs  at  activities  Q3  and  Q4  of  PT6, 
which  moves  from  M3  to  M2.   The  final  schedule,  a  partially  ordered  net- 
work, is  shown  in  Figure  4.5(b).   A  sample  output  is  shown  in  Figure  4.6. 

5.   Performance  Analysis 

5.1  Implementation 

The  nonlinear  planning  procedure  in  algorithm  3.2  is  written  in 
Common  LISP  and  has  been  implemented  on  Explorer,  a  LISP  machine  manu- 
factured by  Texas  Instruments  for  symbolic  processing. 

5.2  Computation  Performance  Analysis 

To  evaluate  the  performance  of  the  nonlinear  planning  algorithm  for 
FMS  scheduling,  we  shall  now  present  a  computation  study  to  analyze  the 
algorithmic  characteristics  of  the  proposed  approach.   This  study  con- 
cerns primarily  with  the  analysis  of  computation  complexity  and  the 
utility  of  heuristic  knowledge. 

The  computation  study  is  conducted  based  on  a  three-machine  FMS 
cell  similar  to  the  one  shown  in  Figure  4.1.   We  randomly  generated  a 
set  of  10  jobs,  each  job  requiring  three  randomly  generated  operations. 
The  operation  loading  of  each  machine  (i.e.,  the  set  of  operations 
assigned  to  the  machine)  is  also  randomly  generated  from  a  pool  of  12 
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operations.   To  reflect  the  flexibility  of  machines,  most  of  the  opera- 
tions can  be  performed  on  at  least  two  of  the  machines;  the  degree  of 
flexibility  turns  out  to  be  an  important  factor  affecting  the  perfor- 
mance of  the  algorithm.   We  use  a  contention  factor,  y,  to  denote 
the  number  of  machines  able  to  execute  a  given  operator.   When  the 
contention  coefficient  for  an  operation  is  greater  than  one,  then 
alternative  routes  may  be  considered  dynamically,   y  turns  out  to  affect 
the  performance  of  the  searching  process  significantly. 

Figure  5.1  shows  the  computation  results.   Two  observations  are 
worth  noting:   First,  the  use  of  A*  heuristics  in  the  planning  process 
significantly  reduces  the  size  of  the  search  tree,  thus  improving  the 
scheduling  performance.   Second,  the  numbers  of  iterations  for 
conflict-resolution  and  plan-revision  grow  faster  than  the  size  of  the 
search  tree.   This  reflects  the  decomposition  strategy  used  in 
Algorithm  3.2. 

To  evaluate  the  impact  of  heuristic  knowledge  on  scheduling  perfor- 
mance, we  compared  the  scheduling  complexity  associated  with  four  dif- 
ferent heuristic  functions;  the  scheduling  complexity  is  measured  by 
the  size  of  search  tree.   The  four  heuristic  functions  are: 

(5.1)  ^n^^^  ~  g(n)  =  the  height  of  node  n  (i.e.,  number  of  levels). 

(5.2)  f-,(n)  =  g(n)  +  h,  (n)  =  (cumulative  processing  time)  + 

(estimated  total  remaining  processing  time) 

(5.3)  i 2^^^    ~   S(^)  ■•"  ^o(ri)  =  (cumulative  processing  time)  + 

(imminent  operation  time) 


(5.4)    f-.(n)  =  g-(n)  +  h  (n)  =  (cumulative  processing  time)  + 


(number  of  remaining  operations). 
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These  four  functions  represent  four  types  of  heuristic  design.   The 
searching  procedure  based  on  f  is  based  on  breadth-first  searching: 
it  exhaustively  enumerates  each  node  at  the  same  level  before  pro- 
ceeding to  the  next  level.   f,  estimates  the  total  processing  time  if 
the  solution  path  should  pass  through  node  n.   f   is  an  extentions  of 
shortest-processing-time  rule  used  in  scheduling  dynamic  job  shops 
(Conway  et  al.  1967;  Rachamadugu,  1982);  it  selects  the  node  whose 
expansion  would  incur  the  least  imminent  cost.   Because  h  (n)  _<  h  (n) 
and  h  (n)  _<  h-(n)  ,  both  f  and  f_  are  admissible  (Lemma  3.2).   On  the 
other  hand,  since  h, (n)  2.  h„(n)  for  all  n,  f^  is  more  informed  than  f 
(Nilsson,  1980).   f^  estimates  the  height  of  the  remaining  tree;  it 
does  not  use  any  processing-time  information. 

The  scheduling  performances,  measured  by  the  size  of  the  search 
tree,  resulting  from  the  four  heuristics  are  shown  in  Figure  5.2.   The 
performance  of  the  searching  results  corresponding  to  the  four  heuristics 
can  be  ranked,  in  the  order  of  decreasing  efficiency,  as:   f , ,  f„,  f_,  f„. 
f  is  an  admissible  heuristic  function  that  reduces  the  search  tree  signi- 
ficantly from  the  breadth-first  search  (represented  by  f^^).   The  fact 
that  f.  performs  better  than  f„  indicates  that  using  more  informed  heu- 
ristics is  more  desirable.   The  search  tree  corresponding  to  f  generates 
more  nodes  than  those  corresponding  to  f.  or  f-  because  f„  does  not 
fully  utilize  all  the  domain-specific  information  availiable  (i.e., 
processing  times). 

Even  with  a  fixed  heuristic  function,  the  scheduling  procedure 
based  Algorithm  3.2  is  affected  by  other  factors  as  well.   It  is  thus 
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important  to  identify  those  important  parameters  so  as  to  achieve  effi- 
cient scheduling.   As  discussed  in  Section  3.2,  the  complexity  of  a 
searching  procedure  is  0(b  ),  where  b  is  the  branching  factor  (the 
average  number  of  branches  coming  out  of  each  node)  and  d  is  the  esti- 
mated depth  (number  of  levels)  of  the  tree.   In  generating  schedules 
with  algorithm  3.2,  b  is  affected  by  the  average  contention  factor, 
Y,  and  the  average  number  of  applicable  operators,  N  ,  at  each  node  (or 
state).   The  depth  of  the  search  tree  is  linearly  proportional  to  the 

number  of  operations,  N  .   Thus,  let  b(Y,N  )  denote  the  branching  fac- 

op  a 

tor  and  d  =  N   x  ^  be  the  depth,  where  the  function  b  and  the  constant 
op  r       7 

C  are  determined  by  the  set  of  operators,  then  the  complexity  of  the 

N   X  C 
schedule-generation  procedure  is  bounded  by  0(b(Y,N  )  op    ), 

The  effect  of  Y,  the  contention  factor,  is  demonstrated  by  the 

contrast  between  Figure  5.2  and  Figure  5.3.   Figure  5.2  indicates  the 

scheduling  performance  for  jobs  with  higher  contention  factors  than  that 

of  Figure  5.3,  and  the  scheduling  process  corresponding  to  testing 

problems  in  Figure  5.2  results  in  larger  search  trees. 

To  test  the  effect  of  N  ,  the  average  number  of  applicable  operators, 

a 

we  solve  the  set  of  scheduling  problems  by  the  set  of  operators  as  shown 
in  Figure  4.1  and  by  the  same  set  of  operators  with  one  addition,  i.e., 
the  macro-operator  MIGRATE.   MIGRATE  is  called  a  "macro-operator"  because 
it  aggregates  the  operator  TRANSFER  and  EXECUTE  shown  in  Figure  4.4. 
The  ways  to  produce  macro-operators  in  an  effort  to  apply  machine 
learning  to  the  FMS  scheduling  problem  can  be  found  in  Shaw  (1986b). 
Since  MIGRATE  has  similar  preconditions  with  that  of  TRANSFER  and 
EXECUTE,  its  addition  increases  the  average  number  of  applicable 
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operators  at  each  state.   Figure  5.4  shows  the  performance  of  the 
testing  problems  when  MIGRATE  is  added  to  the  operator  set;  the 
complexities  increase  from  the  problems  shown  in  Figure  5.3.   In  a 
sense,  the  MIGRATE  operator  "confuses"  the  inference  engine,  increasing 
the  effort  necessary  for  selecting  the  most  appropriate  operators. 

An  interesting  observation  one  can  get  from  Figures  5.2,  5.3  and 
5.4  is  the  degree  of  importance  of  heuristic  knowledge  on  problems 
with  different  complexities.   Problems  in  Figures  5.2  and  5.4  have 
larger  search  trees  than  the  problems  in  Figure  5.3,  and  the  improve- 
ments achieved  by  using  better  heuristic  functions  are  more  signifi- 
cant in  those  more  complex  problems,  as  demonstrated  by  the  larger 
gaps  between  performance  curves  in  Figures  5.2  and  5.4   This  pheno- 
menon indicates  that  choosing  good  heuristic  knowledge  is  more  criti- 
cal in  larger  scheduling  problems. 

In  summary,  the  computation  results  indicate  that:   (1)  the  A* 
heuristic  procedure  improves  the  performance  of  the  planning  algorithm 
for  generating  schedules — this  improvement  is  even  more  significant  for 
more  complicated  problems;  (2)  the  selection  of  heuristic  knowledge  is 
important  and  the  best  heuristic  is  an  admissible  heuristic  that  is  as 
informed  as  possible;  (3)  the  effect  of  good  heuristic  knowledge  becomes 
more  important  as  the  search  tree  grows  larger;  (4)  the  complexity  of 
the  scheduling  procedure  based  on  Algorithm  3.2  is  affected  by  the 
flexibility  of  the  system  and  the  set  of  operators  used.   The 
"flexibility"  of  the  system  is  measured  by  the  contention  factor  of  the 
machines. 
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6.   Conclusion 

This  paper  shows  that  the  pattern-directed  scheduling  approach 
possesses  features  suitable  for  the  FMS  environment.   These  features 
are   (1)  It  Is  data-driven  and  schedules  are  generated  based  on  the 
content  of  the  symbolic  world  model  and  consequently,  the  scheduling  pro- 
cess is  adaptive  to  environmental  changes;  (2)  It  is  goal-directed  and 
the  input  consists  of  specifications  on  the  initial  state  description, 
desired  goal  condition,  and  a  set  of  scheduling  operators — a  nonlinear 
planning  algorithm  is  used  to  generate  schedules,  represented  as  par- 
tially ordered  networks  of  scheduled  activities;  (3)  The  state-space 
representation  provides  a  good  model  for  the  FMS  scheduling  problem; 
its  ability  to  capture  the  need  for  adaptive  scheduling  and  to  account 
for  dynamically  changing  states  is  particularly  suitable  for  handling 
FMS  scheduling;  (4)  It  can  incorporate  domain-specific  heuristic  knowl- 
edge to  make  the  schedule-generation  process  more  efficient;  (5)  It 
can  make  decisions  on  alternative  routes  when  conflicting  machine 
assignments  or  system  failures  occur—there  is,  thus,  no  need  for  pre- 
enumerating  all  the  possible  routes  in  advance;  and  (6)  It  is  compatible 
with  the  physical  symbol  system  hypothesis  for  designing  intelligent 
systems,  providing  a  methodology  for  implementing  intelligent  planning, 
scheduling,  and  machine  learning  for  flexible  manufacturing. 


-28- 


APPENDIX 


Proof  of  Theorem  1 ; 

An  algorithm  is  complete  if  it  can  reach  the  solution  in  finite 
steps;  it  is  correct  if  it  always  finishes  with  a  solution  if  one 
exists.   Since  the  plan-generation  process  in  step  1  of  the  algorithm  is 
based  on  the  A*  algorithm,  the  plan  generated  in  this  step  for  each  sub- 
goal  will  be  correct  and  complete.   So  the  major  proof  rests  on  steps  2-3. 

(Completeness) : 

(i)  If  there  is  no  conflicting  operators  among  the  plans  generated 
in  step  1,  then  the  algorithm  terminates  after  step  1.   The  algorithm 
is  therefore  complete, 

(ii)  If  there  are  conflicting  operators  among  the  plans  generated 
in  step  1,  then  only  finite  pairs  of  operators,  represented  by  the  set 
C,  would  be  identified  as  potentially  conflicting  in  step  2.   C  must  be 
a  finite  set  because  there  are  only  finite  number  of  operators  generated 
in  step  1.   Consequently,  step  2  will  terminate  in  finite  steps.   Step  3 
is  to  identify  a  possible  alternative  resource  for  each  operator  in  C. 
Since  each  C  is  a  finite  set.   Step  3  must  terminate  in  finite  steps. 
Therefore,  the  algorithm  is  complete. 

(Correctness) : 

(i)  If  there  is  no  conflicting  interaction  among  the  plans  generated 
in  step  1,  then  the  algorithm  terminates,  skipping  steps  2  and  3, 
at  the  goal  state.   The  final  plan  consists  of  purely  parallel  plans. 
Therefore,  the  algorithm  is  correct. 
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(ii)  If  there  are  conflicting  interactions  among  the  plans  produced 
by  step  1,  then  step  2  will  introduce  additional  precedence  constraints 
without  changing  any  operators  selected  in  the  plan.   Therefore,  the 
procedure  will  still  terminate  at  the  goal  state.   Step  3  substitutes  a 
section  of  the  plan,  identified  by  critical  resources,  to  reduce  the 
total  duration.   The  goal  state  generated  by  previous  steps  would  not  be 
altered.   Therefore,  the  algorithm  is  correct. 
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